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1. (Original) A method for processing text transcripts of speech after 

imperfect speech recognition, the method comprising the steps of: 
converting a speech document to text; 
5 processing the text to determine salient terms; and 

displaying the text by emphasizing the salient terms and 
minimizing non-salient terms , wherein said salient terms are determined by: 

determining high selectivity terms in the at least one text transcript; 

determining how many high selectivity terms there are; 

10 determining how many multiword and high selectivity terms there 

are that are above a first predetermined selectivity; 

when there are ten or more high selectivity and multiword terms 

that have confidences greater than a first predetermined selectivity, displaying the ten or 
more high selectivity and multiword terms; and 

15 when there are less than ten high selectivity and multiword terms 

that are above a first predetermined selectivity: 

determining how many single word and high 

selectivity terms there are; 

determining if there are ten or more single word and 

20 multiword terms that are high selectivity terms that have selectivities 

greater than a first predetermined selectivity; 

when there are ten or more single word and 

multiword terms that are high selectivity terms that have selectivity greater 
than a first predetermined selectivity, displaying all of the ten or more 
25 single word and multiword terms; and 

when there are not ten or more single word and 

multiword terms that are high selectivity terms that have confidences 
greater than a first predetermined selectivity, displaying all single word 
and multiword terms that are high selectivity terms and that have 
30 confidences greater than a second predetermined selectivity . 
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2. (Original) The method of claim 1, wherein the step of processing the text 

to determine salient terms further comprises the steps of: 

increasing sentence and paragraph structure in the text; 
5 removing non-word utterances from the text; 

determining high selectivity terms in the text; and 

selecting terms from the high selectivity terms that are above a 

predetermined selectivity. 

10 3. (Original) The method of claim 1, further comprising the steps of: 

selecting a salient term; 

determining a time of the salient term relative to a beginning time 
of the speech document; and 

playing the speech document from the time of the salient term. 

15 

4. (Original) The method of claim 1, further comprising the step of creating 
the speech document by recording a conversation, and wherein the step of converting 
comprises performing speech recognition on the speech document, wherein any speakers 
of the speech have not trained the speech recognition system with their own speech. 

20 

5. (Currently Amended) A method for processing text transcripts of speech 
after imperfect speech recognition, the method comprising the steps of: 

converting a speech document to at least one text transcript; 
increasing sentence and paragraph structure in the at least one text 

25 transcript; 

removing non-word utterances from the at least one text transcript; 
determining salient terms in the at least one text transcript; and 
displaying text of the at least one text transcript, the step of 
displaying performed to emphasize display of the salient terms relative to non-salient 
30 terms , wherein said salient terms are determined by: 
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determining high selectivity terms in the at least one text transcript; 

determining how many high selectivity terms there are; 

determining how many multiword and high selectivity terms there 

are that are above a first predetermined selectivity; 

when there are ten or more high selectivity and multiword terms 

that have confidences greater than a first predetermined selectivity, displaying the ten or 
more high selectivity and multiword terms; and 

when there are less than ten high selectivity and multiword terms 

that are above a first predetermined selectivity: 

determining how many single word and high 

selectivity terms there are; 

determining if there are ten or more single word and 

multiword terms that are high selectivity terms that have selectivities 

greater than a first predetermined selectivity; 

when there are ten or more single word and 

multiword terms that are high selectivity terms that have selectivity greater 

than a first predetermined selectivity, displaying all of the ten or more 

single word and multiword terms; and 

when there are not ten or more single word and 

multiword terms that are high selectivity terms that have confidences 

greater than a first predetermined selectivity, displaying all single word 

and multiword terms that are high selectivity terms and that have 

confidences greater than a second predetermined selectivity . 

6. (Original) The method of claim 5, wherein the steps of increasing and 

removing are performed by accessing the at least one transcript and creating processed 
text comprising the at least one transcript with the increased sentence and paragraph 
structure and with fewer non-word utterances. 
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7. (Original) The method of claim 5, wherein the step of displaying text in 

the at least one text transcript further comprises the step of making font size of the non- 
salient terms at least 10 points smaller than font size of the salient terms. 

5 8. (Original) The method of claim 5, wherein the step of displaying text in 

the at least one text transcript further comprises the step of displaying the non-salient 
terms with non-text symbols. 

9. (Original) The method of claim 5, wherein the step of displaying text in 
10 the at least one text transcript further comprises the step of displaying the non-salient 

terms wherein they are unreadable. 

10. (Original) The method of claim 5, wherein the step of determining salient 
terms in the at least one text transcript further comprises the steps of: 

15 determining high selectivity terms in the at least one text transcript; 

and 

selecting terms from the high selectivity terms that are above a 
predetermined selectivity. 

20 11. (Original) The method of claim 10, wherein the step of determining salient 

terms in the at least one text transcript further comprises the step of: 

removing terms whose category is uncertain from the high 

selectivity terms. 

25 12. (Original) The method of claim 10, wherein the step of determining high 

selectivity terms further comprises the step of determining selectivity of terms in the at 
least one text transcript and determining terms having a predetermined selectivity, and 
wherein the step of selecting terms further comprises the step of selecting terms having 
the predetermined selectivity that are above a predetermined threshold. 

30 

13. (Cancelled). 
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14. (Original) The method of claim 5, wherein the step of displaying text 

further comprises the steps of: 

determining a position of a cursor when a click occurs; 
5 determining if the position is within a predetermined distance from 

one of a plurality of salient terms that are being displayed; 

when the position is within the predetermined distance from one of 
the salient terms, performing the following steps: 

determining which of the salient terms is near the 

10 position; 

determining a time of the salient term; and 
playing the speech document, beginning at the time. 



15. (Currently Amended) A system for processing text transcripts of speech 

15 after imperfect speech recognition, the system comprising: 

a memory that stores computer-readable code; and 
a processor operatively coupled to the memory, the 
processor configured to implement the computer-readable code, the computer-readable 
code configured to: 
20 convert a speech document to text; 

process the text to determine salient terms; and 
display the text by emphasizing the salient terms and minimizing 
non-salient terms , wherein said salient terms are determined by: 

determining high selectivity terms in the at least one text transcript; 

25 determining how many high selectivity terms there are; 

determining how many multiword and high selectivity terms there 

are that are above a first predetermined selectivity; 

when there are ten or more high selectivity and multiword terms 

that have confidences greater than a first predetermined selectivity, displaying the ten or 
30 more high selectivity and multiword terms; and 
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when there are less than ten high selectivity and multiword terms 

that are above a first predetermined selectivity: 

determining how many single word and high 

selectivity terms there are; 

5 determining if there are ten or more single word and 

multiword terms that are high selectivity terms that have selectivities 
greater than a first predetermined selectivity; 

when there are ten or more single word and 

multiword terms that are high selectivity terms that have selectivity greater 
10 than a first predetermined selectivity, displaying all of the ten or more 

single word and multiword terms; and 

when there are not ten or more single word and 

multiword terms that are high selectivity terms that have confidences 
greater than a first predetermined selectivity, displaying all single word 
15 and multiword terms that are high selectivity terms and that have 

confidences greater than a second predetermined selectivity . 



16. (Original) The system of claim 15, wherein the computer-readable code is 
further configured, when processing the text to determine salient terms, to: 

20 increase sentence and paragraph structure in the text; 

remove non-word utterances from the text; 
determine high selectivity terms in the text; and 
select terms from the high selectivity terms that are above a 
predetermined selectivity. 

25 

17. (Original) The system of claim 15, wherein the computer-readable code is 
further configured to: 

select a salient term; 

determine a time of the salient term relative to a beginning time of 
30 the speech document; and 

play the speech document from the time of the salient term. 
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18. (Original) The system of claim 15, wherein the computer-readable code is 
further configured to create the speech document by recording a conversation, and 
wherein the computer-readable code is further configured, when converting a speech 

5 document to text, to perform speech recognition on the speech document, wherein any 
speakers of the speech have not trained the speech recognition system with their own 
speech. 

19. (Currently Amended) A system for processing text transcripts of speech 
10 after imperfect speech recognition, the system comprising: 

a memory that stores computer-readable code; and 
a processor operatively coupled to the memory, the 

processor configured to implement the computer-readable code, the computer-readable 

code configured to: 

15 convert a speech document to at least one text transcript; 

increase sentence and paragraph structure in the at least one text 

transcript; 

remove non-word utterances from the at least one text transcript; 
determine salient terms in the at least one text transcript; and 
20 display text of the at least one text transcript, the step of displaying 

performed to emphasize display of the salient terms relative to non-salient terms , wherein 
said salient terms are determined by: 

determining high selectivity terms in the at least one text transcript; 

determining how many high selectivity terms there are; 

25 determining how many multiword and high selectivity terms there 

are that are above a first predetermined selectivity; 

when there are ten or more high selectivity and multiword terms 

that have confidences greater than a first predetermined selectivity, displaying the ten or 
more high selectivity and multiword terms; and 
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when there are less than ten high selectivity and multiword terms 

that are above a first predetermined selectivity: 

determining how many single word and high 

selectivity terms there are; 

5 determining if there are ten or more single word and 

multiword terms that are high selectivity terms that have selectivities 
greater than a first predetermined selectivity; 

when there are ten or more single word and 

multiword terms that are high selectivity terms that have selectivity greater 
10 than a first predetermined selectivity, displaying all of the ten or more 

single word and multiword terms; and 

when there are not ten or more single word and 

multiword terms that are high selectivity terms that have confidences 
greater than a first predetermined selectivity, displaying all single word 
15 and multiword terms that are high selectivity terms and that have 

confidences greater than a second predetermined selectivity. 



20. (Original) The system of claim 19, wherein computer-readable code is 
20 further configured, when determining salient terms in the at least one text transcript, to: 

determine high selectivity terms in the at least one text transcript; 

and 

select terms from the high selectivity terms that are above a 
predetermined selectivity. 

25 

21. (Original) The system of claim 20, wherein computer-readable code is 
further configured, when determining salient terms in the at least one text transcript, to: 

remove terms whose category is uncertain from the high selectivity 

terms. 

30 
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22. (Original) The system of claim 20, wherein computer-readable code is 

further configured, when determining high selectivity terms, to determine selectivity of 
terms in the at least one text transcript and determine terms having a predetermined 
selectivity, and wherein computer-readable code is further configured, when selecting 
5 terms, to select terms having the predetermined selectivity that are above a predetermined 
threshold. 



23. (Original) The system of claim 19, wherein computer-readable code is 

further configured, when displaying text, to; 
10 determine a position of a cursor when a click occurs; 

determine if the position is within a predetermined distance from 
one of a plurality of salient terms that are being displayed; and 

when the position is within the predetermined distance from one of 
the salient terms, perform the following steps: 
15 determine which of the salient terms is near the 

position; 

determine a time of the salient term; and 

play the speech document, beginning at the time. 

20 24. (Currently Amended) An article of manufacture for processing text 

transcripts of speech after imperfect speech recognition, the article of manufacture 
comprising: 

a step to convert a speech document to text; 
a step to process the text to determine salient terms; and 
25 a step to display the text by emphasizing the salient terms and 

minimizing non-salient terms , wherein said salient terms are determined by: 

determining high selectivity terms in the at least one text transcript; 

determining how many high selectivity terms there are; 

determining how many multiword and high selectivity terms there 

30 are that are above a first predetermined selectivity; 
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when there are ten or more high selectivity and multiword terms 

that have confidences greater than a first predetermined selectivity, displaying the ten or 
more high selectivity and multiword terms; and 

when there are less than ten high selectivity and multiword terms 

5 that are above a first predetermined selectivity: 

determining how many single word and high 

selectivity terms there are; 

determining if there are ten or more single word and 

multiword terms that are high selectivity terms that have selectivities 
10 greater than a first predetermined selectivity; 

when there are ten or more single word and 

multiword terms that are high selectivity terms that have selectivity greater 
than a first predetermined selectivity, displaying all of the ten or more 
single word and multiword terms; and 

15 when there are not ten or more single word and 

multiword terms that are high selectivity terms that have confidences 
greater than a first predetermined selectivity, displaying all single word 
and multiword terms that are high selectivity terms and that have 
confidences greater than a second predetermined selectivity . 

20 

25. (Original) The article of manufacture of claim 24, wherein the computer- 

readable code means further comprises, when processing the text to determine salient 
terms: 

a step to increase sentence and paragraph structure in the text; 
25 a step to remove non-word utterances from the text; 

a step to determine high selectivity terms in the text; and 
a step to select terms from the high selectivity terms that are above 
a predetermined selectivity. 

30 26. (Original) The article of manufacture of claim 24, wherein the computer- 

readable code means further comprises: 
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a step to select a salient term; 

a step to determine a time of the salient term relative to a 
beginning time of the speech document; and 

a step to play the speech document from the time of the salient 

5 term. 



27. (Original) The article of manufacture of claim 24, wherein the computer- 
readable code is further configured to create the speech document by recording a 
conversation, and wherein the computer-readable code is further configured, when 

10 converting a speech document to text, to perform speech recognition on the speech 
document, wherein any speakers of the speech have not trained the speech recognition 
article of manufacture with their own speech. 

28. (Currently Amended) An article of manufacture for processing text 
15 transcripts of speech after imperfect speech recognition, the article of manufacture 

comprising: 

a step to convert a speech document to at least one text transcript; 
a step to increase sentence and paragraph structure in the at least 

one text transcript; 

20 a step to remove non-word utterances from the at least one text 

transcript; 

a step to determine salient terms in the at least one text transcript; 

and 

a step to display text of the at least one text transcript, the step of 
25 displaying performed to emphasize display of the salient terms relative to non-salient 
terms , wherein said salient terms are determined by: 

determining high selectivity terms in the at least one text transcript; 

determining how many high selectivity terms there are; 

determining how many multiword and high selectivity terms there 

30 are that are above a first predetermined selectivity; 
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when there are ten or more high selectivity and multiword terms 

that have confidences greater than a first predetermined selectivity, displaying the ten or 
more high selectivity and multiword terms; and 

when there are less than ten high selectivity and multiword terms 

that are above a first predetermined selectivity: 

determining how many single word and high 

selectivity terms there are; 

determining if there are ten or more single word and 

multiword terms that are high selectivity terms that have selectivities 
greater than a first predetermined selectivity; 

when there are ten or more single word and 

multiword terms that are high selectivity terms that have selectivity greater 
than a first predetermined selectivity, displaying all of the ten or more 
single word and multiword terms; and 

when there are not ten or more single word and 

multiword terms that are high selectivity terms that have confidences 
greater than a first predetermined selectivity, displaying all single word 
and multiword terms that are high selectivity terms and that have 
confidences greater than a second predetermined selectivity . 

29. (Original) The article of manufacture of claim 28, wherein computer- 
readable code means further comprises, when determining salient terms in the at least one 
text transcript: 

a step to determine high selectivity terms in the at least one text 

transcript; and 

a step to select terms from the high selectivity terms that are above 
a predetermined selectivity. 

30. (Original) The article of manufacture of claim 29, wherein computer- 
readable code means further comprises, when determining salient terms in the at least one 
text transcript: 
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a step to remove terms whose category is uncertain from the high 

selectivity terms. 

31. (Original) The article of manufacture of claim 29, wherein computer- 
5 readable code i means further comprises, when determining high selectivity terms, a step 

to determine selectivity of terms in the at least one text transcript and a step to determine 
terms having a predetermined selectivity, and wherein computer-readable code means 
further comprises, when selecting terms, a step to select terms having the predetermined 
selectivity that are above a predetermined threshold. 

10 

32. (Original) The article of manufacture of claim 28, wherein computer- 
readable code means further comprises, when displaying text: 

a step to determine a position of a cursor when a click occurs; 
a step to determine if the position is within a predetermined 
15 distance from one of a plurality of salient terms that are being displayed; and 

when the position is within the predetermined distance from one of 
the salient terms, the following steps: 

a step to determine which of the salient terms is 

near the position; 

20 a step to determine a time of the salient term; and 

a step to play the speech document, beginning at the 

time. 
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